Skip to content

HADOOP-19594. Bump Maven 3.9.10 #7760

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: trunk
Choose a base branch
from
Open

HADOOP-19594. Bump Maven 3.9.10 #7760

wants to merge 4 commits into from
+26 −26

Conversation

pan3793
Copy link
Member

@pan3793 pan3793 commented Jun 24, 2025

Description of PR

Maven prior 3.8 is EOL, bump Maven from 3.6.3 to latest 3.9.10

https://maven.apache.org/docs/3.9.10/release-notes.html

Maven 3.9.10 now has a far better support if you want to run your builds on Java 24.

How was this patch tested?

CI.

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

dongjoon-hyun
dongjoon-hyun reviewed Jun 24, 2025
View reviewed changes
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. Thank you.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 32s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 shelldocs 0m 0s Shelldocs was not available.
+0 🆗 markdownlint 0m 0s markdownlint was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 7m 15s Maven dependency ordering for branch
+1 💚 mvninstall 32m 31s trunk passed
+1 💚 compile 15m 48s trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 compile 13m 58s trunk passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 mvnsite 21m 44s trunk passed
+1 💚 javadoc 9m 45s trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 7m 49s trunk passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 shadedclient 52m 15s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 46s Maven dependency ordering for patch
+1 💚 mvninstall 31m 18s the patch passed
+1 💚 compile 15m 19s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javac 15m 19s the patch passed
+1 💚 compile 14m 7s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 javac 14m 7s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 mvnsite 18m 56s the patch passed
+1 💚 shellcheck 0m 0s No new issues.
+1 💚 javadoc 9m 33s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚 javadoc 7m 50s the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚 shadedclient 53m 18s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 669m 52s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 1m 38s The patch does not generate ASF License warnings.
952m 47s
Reason Tests
Failed CTEST tests test_test_libhdfs_ops_hdfs_static
test_test_libhdfs_threaded_hdfs_static
test_test_libhdfs_zerocopy_hdfs_static
test_test_native_mini_dfs
test_libhdfs_threaded_hdfspp_test_shim_static
test_hdfspp_mini_dfs_smoke_hdfspp_test_shim_static
libhdfs_mini_stress_valgrind_hdfspp_test_static
memcheck_libhdfs_mini_stress_valgrind_hdfspp_test_static
test_libhdfs_mini_stress_hdfspp_test_shim_static
test_hdfs_ext_hdfspp_test_shim_static
Failed junit tests hadoop.hdfs.server.federation.security.token.TestZKDelegationTokenSecretManagerImpl
hadoop.mapred.gridmix.TestGridmixSubmission
hadoop.mapred.gridmix.TestSleepJob
hadoop.mapred.gridmix.TestLoadJob
hadoop.crypto.key.kms.server.TestKMSAudit
hadoop.yarn.client.TestGetGroups
hadoop.yarn.client.TestRMFailover
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/2/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets mvnsite unit shellcheck shelldocs markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux 4f1aa0b68ba4 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / ec7b4b5
Default Java Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
CTEST https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/2/artifact/out/patch-root-ctest.txt
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/2/testReport/
Max. process+thread count 3688 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-auth . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/2/console
versions git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@pan3793 pan3793 marked this pull request as draft July 4, 2025 12:49
@pan3793
Copy link
Member Author

pan3793 commented Jul 4, 2025

I just found that the Maven installation is different from each OS docker image ...
Maybe we should use Maven Wrapper? @steveloughran @slfan1989 @cnauroth thought?

@steveloughran
Copy link
Contributor

never used mvnw; not sure if I'd rush to, but for docker images it makes a lot of sense as a single control point -and makes it trivial for PRs to test new versions, rollback etc

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/3/console in case of problems.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/4/console in case of problems.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 25m 6s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 7s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/4/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets yamllint compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle shellcheck shelldocs hadolint jsonlint xmllint markdownlint
uname Linux 25fd381822d8 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 652e995
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/4/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 37m 14s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 8s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/3/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets yamllint compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle shellcheck shelldocs hadolint jsonlint xmllint markdownlint
uname Linux eac4c3014fbb 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 652e995
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/3/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/5/console in case of problems.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 40s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 7s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/5/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets yamllint compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle shellcheck shelldocs hadolint jsonlint xmllint markdownlint
uname Linux bca33c03214d 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / cb1d91d
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/5/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/6/console in case of problems.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 34s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 8s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/6/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets yamllint compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle shellcheck shelldocs hadolint jsonlint xmllint markdownlint
uname Linux ac460178bdda 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / cb1d91d
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/6/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 12m 56s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 7s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/7/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux daee2a68ff7d 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 044d07b
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/7/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 35s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 6s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/8/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux 5e2e4896dfcb 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 66a44b2
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/8/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 35s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 7s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/9/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux 04b6ae407143 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / e632214
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/9/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/10/console in case of problems.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 35s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 7s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/10/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux a809e2945279 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 10065e6
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/10/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/11/console in case of problems.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/12/console in case of problems.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 49s Docker mode activated.
_ Prechecks _
-1 ❌ maven 0m 9s ERROR: maven was not available.
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/12/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux 5f2cc6e3180c 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / ece1483
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/12/console
versions git=2.9.5
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/13/console in case of problems.

@pan3793 pan3793 marked this pull request as ready for review July 7, 2025 08:38
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 10m 23s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 hadolint 0m 0s hadolint was not available.
+0 🆗 shellcheck 0m 0s Shellcheck was not available.
+0 🆗 shelldocs 0m 0s Shelldocs was not available.
+0 🆗 jsonlint 0m 0s jsonlint was not available.
+0 🆗 markdownlint 0m 0s markdownlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 5m 22s Maven dependency ordering for branch
-1 ❌ mvninstall 33m 10s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 13m 11s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 4m 48s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 6m 39s /branch-javadoc-root.txt root in trunk failed.
-1 ❌ shadedclient 7m 53s branch has errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 49s Maven dependency ordering for patch
-1 ❌ mvninstall 30m 44s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 12m 45s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 12m 45s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 4m 56s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 1s No new issues.
-1 ❌ javadoc 6m 41s /patch-javadoc-root.txt root in the patch failed.
-1 ❌ shadedclient 9m 2s patch has errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 676m 28s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 1m 44s The patch does not generate ASF License warnings.
816m 0s
Reason Tests
Failed CTEST tests test_test_libhdfs_ops_hdfs_static
test_test_libhdfs_threaded_hdfs_static
test_test_libhdfs_zerocopy_hdfs_static
test_test_native_mini_dfs
test_libhdfs_threaded_hdfspp_test_shim_static
test_hdfspp_mini_dfs_smoke_hdfspp_test_shim_static
libhdfs_mini_stress_valgrind_hdfspp_test_static
memcheck_libhdfs_mini_stress_valgrind_hdfspp_test_static
test_libhdfs_mini_stress_hdfspp_test_shim_static
test_hdfs_ext_hdfspp_test_shim_static
Failed junit tests hadoop.fs.TestHdfsNativeCodeLoader
hadoop.hdfs.server.federation.security.token.TestZKDelegationTokenSecretManagerImpl
hadoop.mapred.gridmix.TestGridmixSubmission
hadoop.mapred.gridmix.TestSleepJob
hadoop.mapred.gridmix.TestLoadJob
hadoop.crypto.TestCryptoCodec
hadoop.util.TestNativeCodeLoader
hadoop.crypto.key.kms.server.TestKMSAudit
hadoop.yarn.server.federation.policies.amrmproxy.TestLocalityMulticastAMRMProxyPolicy
hadoop.yarn.client.TestGetGroups
hadoop.yarn.client.TestRMFailover
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/13/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux 8fe519ac470d 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 5e5bab1
Default Java Red Hat, Inc.-1.8.0_412-b08
CTEST https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/13/artifact/out/patch-root-ctest.txt
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/13/testReport/
Max. process+thread count 3371 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-auth . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/13/console
versions git=2.9.5 maven=3.9.10 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 33m 29s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 hadolint 0m 0s hadolint was not available.
+0 🆗 shellcheck 0m 0s Shellcheck was not available.
+0 🆗 shelldocs 0m 0s Shelldocs was not available.
+0 🆗 jsonlint 0m 0s jsonlint was not available.
+0 🆗 markdownlint 0m 0s markdownlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 5m 22s Maven dependency ordering for branch
-1 ❌ mvninstall 32m 23s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 12m 52s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 4m 55s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 6m 52s /branch-javadoc-root.txt root in trunk failed.
-1 ❌ shadedclient 8m 2s branch has errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 47s Maven dependency ordering for patch
-1 ❌ mvninstall 31m 45s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 12m 35s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 12m 35s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 4m 55s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 0s No new issues.
-1 ❌ javadoc 6m 42s /patch-javadoc-root.txt root in the patch failed.
-1 ❌ shadedclient 9m 3s patch has errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 693m 27s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 1m 48s The patch does not generate ASF License warnings.
855m 27s
Reason Tests
Failed CTEST tests test_test_libhdfs_ops_hdfs_static
test_test_libhdfs_threaded_hdfs_static
test_test_libhdfs_zerocopy_hdfs_static
test_test_native_mini_dfs
test_libhdfs_threaded_hdfspp_test_shim_static
test_hdfspp_mini_dfs_smoke_hdfspp_test_shim_static
libhdfs_mini_stress_valgrind_hdfspp_test_static
memcheck_libhdfs_mini_stress_valgrind_hdfspp_test_static
test_libhdfs_mini_stress_hdfspp_test_shim_static
test_hdfs_ext_hdfspp_test_shim_static
Failed junit tests hadoop.fs.TestHdfsNativeCodeLoader
hadoop.hdfs.server.federation.security.token.TestZKDelegationTokenSecretManagerImpl
hadoop.mapred.gridmix.TestGridmixSubmission
hadoop.mapred.gridmix.TestSleepJob
hadoop.mapred.gridmix.TestLoadJob
hadoop.crypto.TestCryptoCodec
hadoop.util.TestNativeCodeLoader
hadoop.crypto.key.kms.server.TestKMSAudit
hadoop.yarn.client.TestGetGroups
hadoop.yarn.client.TestRMFailover
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/11/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux 53064ea46e73 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 5e5bab1
Default Java Red Hat, Inc.-1.8.0_412-b08
CTEST https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/11/artifact/out/patch-root-ctest.txt
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/11/testReport/
Max. process+thread count 3474 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-auth . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/11/console
versions git=2.9.5 maven=3.9.10 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@steveloughran
Copy link
Contributor

CTest failures look related to junit api assertions now needed on the CP wherever minidfs cluster is created

2025-07-06 23:38:12,551 [main] INFO  Configuration.deprecation (Configuration.java:logDeprecation(412)) - fs.default.name in core-default.xml is deprecated. Instead, use fs.defaultFS
nmdCreate: NativeMiniDfsCluster#Builder#Builder error:
ClassNotFoundException: org.junit.jupiter.api.Assertionsjava.lang.NoClassDefFoundError: org/junit/jupiter/api/Assertions
	at org.apache.hadoop.test.GenericTestUtils.assertExists(GenericTestUtils.java:281)
	at org.apache.hadoop.test.GenericTestUtils.getTestDir(GenericTestUtils.java:225)
	at org.apache.hadoop.test.GenericTestUtils.getTestDir(GenericTestUtils.java:234)
	at org.apache.hadoop.hdfs.MiniDFSCluster.getBaseDirectory(MiniDFSCluster.java:3126)
	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.<init>(MiniDFSCluster.java:239)
Caused by: java.lang.ClassNotFoundException: org.junit.jupiter.api.Assertions
	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	... 5 more

maybe we should try to cull that check

@pan3793
Copy link
Member Author

pan3793 commented Jul 8, 2025

@steveloughran do you mean #7782?

@pan3793
Copy link
Member Author

pan3793 commented Jul 9, 2025

#7782 gets merged, rebase this PR

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/14/console in case of problems.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 39s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 hadolint 0m 1s hadolint was not available.
+0 🆗 shellcheck 0m 1s Shellcheck was not available.
+0 🆗 shelldocs 0m 1s Shelldocs was not available.
+0 🆗 jsonlint 0m 1s jsonlint was not available.
+0 🆗 markdownlint 0m 1s markdownlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 6m 49s Maven dependency ordering for branch
-1 ❌ mvninstall 32m 7s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 11m 35s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 4m 50s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 6m 32s /branch-javadoc-root.txt root in trunk failed.
-1 ❌ shadedclient 7m 50s branch has errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 51s Maven dependency ordering for patch
-1 ❌ mvninstall 30m 44s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 10m 56s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 10m 56s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 4m 48s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 0s No new issues.
-1 ❌ javadoc 6m 19s /patch-javadoc-root.txt root in the patch failed.
-1 ❌ shadedclient 8m 56s patch has errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 662m 19s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 1m 51s The patch does not generate ASF License warnings.
788m 17s
Reason Tests
Failed junit tests hadoop.fs.TestHdfsNativeCodeLoader
hadoop.hdfs.server.federation.security.token.TestZKDelegationTokenSecretManagerImpl
hadoop.mapred.gridmix.TestGridmixSubmission
hadoop.mapred.gridmix.TestSleepJob
hadoop.mapred.gridmix.TestLoadJob
hadoop.yarn.sls.appmaster.TestAMSimulator
hadoop.crypto.TestCryptoCodec
hadoop.util.TestNativeCodeLoader
hadoop.crypto.key.kms.server.TestKMSAudit
hadoop.yarn.applications.distributedshell.TestDSWithMultipleNodeManager
hadoop.yarn.applications.distributedshell.TestDSTimelineV10
hadoop.yarn.applications.distributedshell.TestDSTimelineV15
hadoop.yarn.applications.distributedshell.TestDSTimelineV20
hadoop.yarn.client.TestGetGroups
hadoop.yarn.client.TestRMFailover
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/14/artifact/out/Dockerfile
GITHUB PR #7760
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint markdownlint compile javac javadoc mvninstall shadedclient xmllint
uname Linux cc9771e19037 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 2d2d88d
Default Java Red Hat, Inc.-1.8.0_412-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/14/testReport/
Max. process+thread count 3405 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-auth . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/14/console
versions git=2.9.5 maven=3.9.10 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@pan3793
Copy link
Member Author

pan3793 commented Jul 10, 2025

@steveloughran

Should we continue to process "Dropping support for builds on Centos 7" ? https://lists.apache.org/thread/yj5lx4lmrflyqyfvwmjt74y3jcl65tk0

@slfan1989
Copy link
Contributor

slfan1989 commented Jul 10, 2025 •
edited
Loading

@pan3793 Thanks to Pan for the contribution! Personally, I’m not in a hurry to upgrade to Maven 3.9. I believe this PR should be merged after the unit tests have been fully upgraded. Currently, apart from Spark, I haven’t noticed any other projects upgrading to Maven 3.9, at least not in Ozone and Ratis. I hope we can proceed with JDK 17 support at our own pace.
cc: @steveloughran

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dongjoon-hyun dongjoon-hyun dongjoon-hyun left review comments

Assignees
No one assigned
Labels
build Common Infra MapReduce Maven-Plugins Native trunk
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@pan3793 @hadoop-yetus @steveloughran @slfan1989 @dongjoon-hyun